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(54) Method and apparatus for controlling conditional branch execution in a data processor 



(57) A pipelined data processing system (10) 
Includes a scheme for selectively controlling forward 
branch prediction and backward branch prediction, as 
well as prefetching and conditional execution of instruc- 
tions for various branch scenarios. A three bit program- 
mer accessible control field (19) is used to specify the 
type of activity to be used with a conditional branch 
instruction by allowing the independent control of 
prefetching of instructions for both forward and back- 



ward conditional branches. Also, control over condi- 
tional execution is provided for both forward and 
backward branches. By allowing independent control of 
fonward and backward branch prediction and conditional 
execution, pipeline stalls can be reduced and more flex- 
ible program execution can be achieved for different 
environments. 
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Description 

Field of the Invention 

This invention relates to data processing, and more 
specifically to a method and apparatus for controlling 
conditional branch execution In a data processor. 

Background of the Invention 

A data processing system is "pipelined" if it includes 
a number o1 stages for program execution. For example, 
a four stage pipeline may include a fetch stage, decode 
stage, execution stage, and a write-back stage. During 
the fetch stage, a next instruction is retrieved from a 
memory location. Then the instruction is decoded, exe- 
cuted, and written back to a location in memory, or to a 
register. Each of these stages may re^quire one or more 
clock cycles to complete. Also, simultaneously with the 
first instruction being decoded, a second instruction 
may be fetched, and while the first instruction is being 
executed, the second instruction may be decoded, and 
so forth, so that the "pipeline" remains full. 

Pipelined data processing systems may incur exe- 
cution penalties when a program being executed 
includes a change of flow instruction. When a change of 
flow occurs, it may be necessary for the data processing 
system to stop execution of program flow in order to 
refill the instruction pipeline. 

Various schemes such as branch prediction, 
prefetching and conditional execution are among the 
techniques used to improve performance when a 
change of flow is Incurred. However, many of these 
schemes add increased complexity to the data process- 
ing system and may not be effective in every environ- 
ment. Therefore, a need exists for providing control over 
branch prediction destination prefetching and condi- 
tional execution that Is adaptable for different environ- 
ments. 

Brief Description of the Drawings 

FIG. 1 illustrates, in block diagram form, a pipelined 
data processing system in accordance with the 
present invention. 

FIG. 2 illustrates a series of instructions which are 
helpful for describing the present invention. 

FlGs, 3-1 1 illustrate. In timing diagram form, various 
cases for illustrating branch control in accordance 
with the present invention. 

FIG. 12 illustrates a table of control values for the 
branch control field of FIG. 1 and the applicable 
CASES 1 - 9 that correspond to the action associ- 
ated with each control value. 
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Detailed Description of a Preferred Embodiment 

Generally, the present invention provides a data 
processing system and method for selectively control - 

5 ling forward branch prediction and backward branch 
prediction, as well as prefetching and conditional execu- 
tion of instructions for various branch scenarios. A three 
bit programmer accessible control field is used to spec- 
ify the type of activity to be used with a conditional 

10 branch instruction by allowing the independent control 
of prefetching of instructions for both forward and tack- 
ward conditional branches. Also, control over condi- 
tional execution is provided for both forward and 
backward branches. By allowing independent control of 

15 forward and backward branch prediction and conditional 
execution, pipeline stalls can be reduced and more flex- 
ible program execution can be achieved for different 
environments. More specifically, the present invention 
may be further described with reference to FIGs. 1-12. 

20 FIG. 1 illustrates, in block diagram form, a pipelined 
data processing system 10 in accordance with the 
present invention. Data processing system 10 includes 
memory 12 and data processor 14. Data processor 14 
includes address buffer 1 6. address multiplexer 24, con- 

25- trol unit 18. branch control bit field 19. instruction fetch 
unit 26, instruction decoder 32, execution unit 40, bus 
interface unit 23, data input buffer 20. and data output 
buffer 22. Instruction fetch unit 26 includes program 
control calculation block 28 and instruction buffer 30. 

30 Memory 1 2 is coupled to an address bus for receiv- 
ing an address, and to a data bus for receiving and pro- 
viding data. Memory 12 can be any kind of conventional 
memory including volatile memories such as static ran- 
dom access memories (SRAMs). and dynamic random 

35 access memories (DRAMs) or non-volatile memories 
such as electrically programmable read only memories 
(EPROM) and flash memory. Also, memory 12 may be 
on the same integrated circuit as processor 14 or may 
be located externally to processor 14. Address multi- 

40 plexer 24 has a first plurality of input terminals for 
receiving an operand address from execution unit 40. a 
second plurality of Input terminals for receiving an 
instruction address from instruction fetch unit 26, arxi a 
plurality of output terminals coupled to address buffer 

45 1 6. Address multiplexer 24 is controlled by bus interface 
unit 23 for directing either the operand address or the 
instruction address to memory 12. Instruction fetch unit 
26 is coupled to data input buffer 20 for sequentially 
fetching selected instructions from memory 12. 

50 Instruction decoder 32 is coupled to instruction 
fetch unit 26 via buses 42 and 44. Instruction fetch unit 
26 provides an instruction address to obtain an instruc- 
tion encoding value. Instruction decoder 32 receives the 
instruction encocfing value from Instruction fetch unit 26, 

55 prepares the instruction encoding value by translating 
the instruction encoding value into a format which can 
be executed by data processor 14. and selectively 
decodes the Instructions which are fetched by instruc- 
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tion fetch unit 26. Instruction decoder 32 is coupled to 
execution unit 40 via buses 42 and 44. Execution unit 40 
is coupled to data input buffer 20 for receiving data from 
memory 12. Likewise, execution unit 40 is coupled to 
data output buffer 22 for providing'data to memory 12. 5 
Execution unit 40 selectively executes the instructions 
which are decoded by instruction decoder 32, and pro- 
vides the result to data output buffer 22. Execution unit 
40 may include, for example, an arithmetic logic unit 
(ALU). 70 

Bus interface unit 23 receives an operand access 
request from instruction unit 40. and in response, pro- 
vides access control signals to memory 12 for access- 
ing data to be operated on. Also, bus interface unit 23 is 
coupled to instruction fetch unit 26 for receiving an is 
instruction access request for accessing memory 1 2 for 
instructions. Bus interface unit 23 is bt-directionally cou- 
pled to control unit 18 via a bus 54 for coordinating 
instruction sequencing in data processing system 10. 

Control unit 18 Is bi-directionally coupled to instruc- 20 
tion fetch unit 26 via control bus 48 for controlling the 
operation of instruction fetch unit 26. Control unit 18 is 
bi-directionally coupled to instruction decoder 32 via 
control bus 50 and control unit 18 is bi-directionally cou- . 
pled to execution unit 40 via control bus 52. Execution 25 
unit 40 is coupled to instruction fetch unit 26 via condi- 
tion bus 46 for providing condition information to instruc- 
tion fetch unit 26, In the illustrated embodiment, branch . 
control field 19 is a three bit control field of a register 
within control unit 1 8 which stores information for select- so 
ing policies for controlling forward and backward branch 
prefetching and conditional instruction execution. In 
other embodiments, the control field may include one or 
more bits. The control field 19 directly controls instruc- 
tion fetch unit 26 by disabling instruction fetch unit 26 for 35 
a predetermined amount of time in response to a condi- 
tional flow instruction {conditional branch instruction) 
being detected by the instruction decoder 32. The con- 
trol unit provides a control signal to instruction fetch unit 
26 in response to the value stored in branch control field 40 
19. Branch control field 19 determines one of several 
modes of operation in which instruction fetch unit 26 
fetches further instructions when instruction decoder 32 
determines that a conditional branch instruction has 
been encountered (see FIG. 12). The modes of opera- 45 
tion are determined by the direction of instruction flow 
(backward branch or a forward branch) indicated by the 
conditional branch instruction. The conditional flow 
instruction may be, for example, a trap or a jump instruc- 
tion. 50 

Disabling instruction fetch unit 26 reduces over- 
head of data processing system 10 by completely avoid- 
ing a fetch operation until the predetermined amount of 
time has elapsed. After the predetermined amount of 
time elapses, instruction fetch unit 26 automatically 55 
resumes operation. Instruction fetch unit 26 may also be 
disabled for both forward and backward branches. 

Data processing system 10 executes instructions in 
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a four stage pipeline. The four stages include a fetch 
stage, a decode stage, an execution stage, and a write 
t)ack stage. During the instruction fetch stage, an 
instruction is retrieved from memory, such as from 
memory 12. The instruction is then decoded in instruc- 
tion decoder 32. The decoded instruction is provided to 
execution unit 40 via bus 42. The execution unit 40 exe- 
cutes the instruction and then writes back the results to 
memory 1 2 via data output buffer 22. 

FIG. 2 illustrates a series of instructions which are 
helpful for describing the present invention. For pur- 
poses of describing the invention, the type of instruction 
is not important. Therefore, the instruction associated 
with each instruction number in FIG. 2 is represented by 
a single letter. In the course of executing the instructions 
of FIG. 2, data processing system 10 will sequentially 
execute each instruction until encountering an instruc- 
tion that requires data processing system 10 to go to 
another instruction which may not be the next sequen- 
tial instruction, such as for example, a conditional 
branch instruction. In FIG. 2, instruction number 4 illus- 
trates a conditional branch instruction labeled "V". After 
executing instruction V, the data processing system 10 
is required to either execute the next instruction in the 
sequence or go to instruction W based on a result 
obtained after executing instruction V. The conditional 
flow is represented with curved arrows originating at 
instruction V. In order to more efficiently execute the 
series of instructions shown in FIG. 2, data processing 
system 10 may try to predict whether the branch is to 
instruction X or to instruction W based on the predeter- 
mined control information contained in branch control 
field 19. In addition to determining whether or not to per- 
form branch prediction, branch control field 19 may also 
be used to determine whether or not conditional execu- 
tion of a predicted next instruction step is performed. 

Branch control field 19 allows independent control 
over prefetching, prediction and conditional execution 
associated with conditional flow instructions. According 
to one aspect of the invention, based on tiie control bits 
of branch control field 19, a next instruction is not 
fetched until a condition is resolved in the current 
instruction being executed. Since the next instruction is 
not fetched, a delay caused by prefetching an instruc- 
tion which may later be discarded in data processing 
unit 10 is reduced. Also, power consumption may be 
reduced by eliminating unnecessary prefetching and 
execution. In addition, the data processing system exe- 
cutes instructions faster and more efficiently. In addition, 
the invention adds flexibility by allowing the user to 
choose to prefetch a backward branch but not a forward 
branch, if that would cause the particular program to be 
more efficiently executed in a pipelined processor. 

FlGs. 3-11 illustrate, in timing diagram form, various 
cases for describing branch control in accordance with 
the present Invention. The examples illustrated in FIGs, 
3-1 1 use the instruction flow of FIG. 2 for illustration pur- 
poses. 
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FIG. 3 illustrates a timing diagram of a CASE 1 in 
which no prefetch in either a forward or a backward 
branch in data processing system 10 is performed. In 
FIG. 3, each of the four pipeline stages of data proces- 
sor 10 are illustrated. During a first clock cycle, instruc- 
tion T, which is instruction 2 in FIG. 2. is fetched. During 
a second clock cycle, instruction U is fetched, and 
simultaneously with instruction U being fetched, instruc- 
tion T is decoded. At clock cycle 3, instruction V Is 
fetched while instruction U is decoded. Instruction V is 
illustrated as being a forward branch instruction as indi- 
cated by the arrows pointed to instruction X and instruc- 
tion W. If the control bits in branch control field 19 (FIG. 
1) indicate that no forward branches are to be 
prefetched, then at clock cycle 4, processor 10 will not 
prefetch the next instruction as indicated by the word 
"stall". However, instruction V will be decoded, and 
instruction U executed since they are in later stages of 
the pipeline. The stall at clock cycle 4 is inserted to allow 
instruction V to resolve in order to know whether instruc- 
tion X or instruction W is to be fetched in the next clock 
cycle. Once the condition is resolved as indicated at the 
end of clock cycle 4. the appropriate instruction can 
then be fetched. See FIG. 12 for the control field values 
that apply to CASE 1. 

FIG. 4 illustrates, in timing diagram form, a CASE 2 
where the prefetch destination was correctly predicted. 
For illustration purposes. FIG. 4 Illustrates a backward 
branch. However, FIG. 4 would apply equally to a for- 
ward branch. In clock cycle 1 , instruction Z, illustrated in 
FIG. 2, is fetched. At clock cycle 2, the next sequential 
instruction, instruction W, is fetched while instruction Z 
is being decoded. At clock cycle 3, instruction Q is 
fetched, instruction W is decoded, and instruction Z is 
executed. Instruction Q is a conditional backward 
branch instruction where the next instruction can be 
instruction S or instruction R. For purposes of illustra- 
tion, instruction S is predicted to be the next instruction. 
So, instruction S is prefetched, instruction Q is decoded, 
instruction W is executed, and instruction Z is written 
back. At the end of clock cycle 4. the condition is 
resolved to indicate that instruction S was the correct 
instruction and at clock cycle 5, instruction S is then 
decoded while instruction T is prefetched, instruction Q 
is executed, and instruction W is written back. No pipe- 
line stalls are incurred in CASE 2. 

FIG. 5 illustrates, in timing diagram form, a CASE 3 
where a prefetch destination is incorrectly predicted. At 
clock cycle 1. instruction Z (FIG. 2) is fetched. At clock 
cycle 2, instruction W is fetched and at dock cycle 3, 
instruction Q is fetched, and instruction Q is a condi- 
tional backward branch instruction. If backward branch 
prefetch has been selected in branch control field 19, 
instruction S is prefetched at clock cycle 4. (See FIG. 1 2 
for the control field values that apply to CASE 3.) During 
clock cycle 5. instruction Q is executed and it is deter- 
mined that the prefetch of instruction S was incorrect. 
The pipeline stalls while the correct instruction, instruc- 



tion R is fetched. Once instruction R is fetched at clock 
cycle 6. normal execution resumes. 

FIG. 6 illustrates, in timing diagram form, a CASE 4 
where a sequential prefetch is correctly predicted. At 

5 clock cycle 3, branch instruction V is fetched because 
branch control field 19 indicates that the prefetch should 
be sequential. During clock cycle 4, instruction X is 
fetched. At clock cycle 5 instruction V is executed and 
the condition is resolved to indicate that instruction X 

10 was the correct instruction to prefetch. Normal execu- 
tion continues with instruction X. 

FIG. 7 illustrates, in timing diagram form, a CASE 5 
where the instruction prefetch Is sequential and incor- 
rectly predicted. At clock cycle 3, instruction V is 

15 prefetched, where instruction V is a conditional forward 
branch instruction. Since the next instruction is instruc- 
tion X at clock cycle 4, instruction X is fetched. At clock 
cycle 5. instruction V is executed. The condition is 
resolved indicating that instruction X was the incorrect 

20 instruction to prefetch. Since the prefetch was incorrect, 
at clock cycle 6, the correct instruction, instruction W, is 
fetched and the pipeline is refilled. 

FIG. 8 illustrates, in timing diagram form, a CASE 6 
where conditional execution has been enabled and a 

25 prediction of branch taken was correct. At clock cycle 3, 
a forward branch instruction V is fetched. The branch 
was predicted to be taken, so Instruction W is fetched. 
Instruction W is executed at clock cycle 6 before the 
condition is resolved . After clock cycle 6, the condition 

30 is resolved, and the prediction was correct, so the pipe- 
line flow can continue. 

FIG. 9 illustrates, in timing diagram form, a CASE 7 
illustrating a conditional execution where a branch was 
incorrectly predicted as taken. As discussed above for 

35 FIG. 8. instruction W is predicted to be the next instruc- 
tion. However, in this case instruction W is the incorrect 
instruction. So, at the end of clock cycle 6, the condition 
is resolved and at clock cycle 7, the correct instruction, 
instruction X, is fetched and the pipeline must be refilled 

40 with the correct instructions. 

FIG. 10 illustrates, in timing diagram form, a CASE 

8 illustrating conditional execution where a branch was 
correctly predicted as not taken. At clock cycle 3. 
instruction V is the forward branch instruction, and 

45 because the prediction is not taken, the next sequential 
instruction, instruction X. is fetched. At the end of clock 
cycle 6 when instruction X is executed, the condition is 
resolved correctly and the pipeline flow remains undis- 
turbed. 

so FIG. 1 1 illustrates, in timing diagram form, a CASE 

9 showing conditional execution where the branch pre- 
diction was incorrectly predicted as not taken. After 
fetching the twanch instruction V at clock cycle 3. the 
next sequential instruction to be fetched is instruction X 

55 (see FIG. 2). At the end of dock cycle 6 in FIG. 1 1 . the 
condition resolves incorrectly. Because the correct 
instruction should have been instruction W, instruction 
W is fetched at clock cycle 7 and the pipeline stalls while 
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it is being filled with the correct instructions. 

FIG. 12 illustrates a table of control values for 
branch control field 19 of FIG. 1 and the applicable 
CASES 1 - 9 that correspond to each control value. 
Branch control field 1 9 is part of a programmer's model s 
for data processing 10. In the illustrated embodiment 
branch control field 19 can be updated by inserting 
appropriate instructions within the sequence of instruc- 
tions to be executed. This allows for efficient use of - 
branch prediction in both forward and backward condi- io 
tional branching for both prefetching and conditional 
execution. 

The following is a summary of the actions that are 
taken for each control value in FIG. 12: 

15 

If the branch control field includes 000 - Prefetch 
predict for either forward or backward branches are 
not made until branch conditions are resolved; 



forward branches (i.e., prediction not taken, allow 
conditional execution). 

By independently allowing control over prefetching 
prediction and conditional execution for branch instruc- 
tions, processing time may be used more efficiently 
since pipeline stalls as a result of incorrect predictions 
can be reduced. 

Althiough the invention has been described and 
illustrated with reference to specific embodiments 
thereof, it is not intended that the invention be limited to 
these illustrative embodiments. Those skilled in the art 
will recognize that variations and modifications can be 
made without departing from the spirit of the invention. 
Thus it is intended to encompass within the invention all 
sucfi variations and modifications falling within the 
scope of the appended claims. 

Claims 

1. A data processor (10) which executes a plurality of 
instructions, including at least one change of flow 
instruction, comprising: 

an instruction prefetch unit (26) for sequentially 
fetching selected ones of the plurality of 
instructions; 

an instruction decode unit (32) coupled to the 
instruction prefetch unit (26) for selectively 
decoding the selected ones of the plurality of 
instructions which are fetched by the instruc- 
tion prefetch unit (26); 

an instruction execution unit (40) coupled to the 
instruction decode unit (32), the instruction 
execution unit (40) selectively executing the 
plurality of instructions which are decoded by 
the instruction decode unit (40); and 
a control unit (18) coupled to the instruction 
prefetch unit (26), the instruction decode unit 
(32) and the instruction execution unit (40). the 
control unit (18) having a stored control value 
which directly controls the instruction prefetch 
unit (26) by selectively disabling for a predeter- 
mined amount of time the instruction prefetch 
unit (26) from fetching any further instructions 
in direct response to a conditional flow instruc- 
tion being detected by the instruction decode 
unit (32), the disabling of the instruction 
prefetch unit (26) reducing overhead of the 
data processor (10) by completely avoiding a 
fetch operation until the predetermined amount 
of time has elapsed, at which time prefetching 
by the instruction prefetch unit (26) is automat- 
ically resumed. 

2. The data processor (10) of claim 1 wherein the con- 
ditional floyv instruction is a conditional branch 
instruction. 



If the branch control field includes 001 - The desti- 20 
nation of a backward branch is prefetched, but 
there is no prefetch prediction for forward branches; 

If the branch control field includes 010 - Prefetch 
the destination and allow conditional execution of a 25 
backward branch destination (i.e.. predict back- 
wards is taken and prefetch destination, with condi- 
tional execution), no prefetch prediction for forward 
branches; 

30 

If the branch control field includes Oil - Prefetch 
destination of backward branch (i.e., predict taken 
and prefetch destination, but no corxJitionai execu- 
tion), prefetch sequential instruction for forward 
branches (i.e.. predict not taken, but no conditional 35 
execution); 

If the branch control field includes 100 - Prefetch 
destination of both branch directions (i.e.. predict 
taken, but no conditional execution); 40 

If the branch control field includes 101 - Prefetch 
the destination of both branch directions, allow con- 
ditional execution of predicted backward branches 
(i.e.. predict taken, but no conditional execution for 45 
forward branches). 

If the branch control field includes 110 - Prefetch 
destination of both branch directions, allow condi- 
tional execution of predicted branches (i.e., predict so 
taken, and allow conditional execution for all 
branches); and 

If the branch control field includes 1 1 1 - Prefetch 
destination of backward branch, allow conditional 55 
. execution of predicted backward branches (i.e. pre- 
dict taken and prefetch destination, allow condi- 
tional execution). Prefetch sequential instruction for 
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The data processor (10) of claim 2 wherein the 
instruction prefetch unit (26) is disabled from fetch- 
ing further instructions in response to detecting the 
conditional branch instruction, regardless of the 
direction in instruction flow indicated by the detec- 5 
tion of the conditional branch instruction. 

The data processor (10) of claim 1 wherein the pre- 
determined amount of time in which the stored con- 
trol value disables the instruction prefetch unit (26) 10 
from fetching any further instructions is an amount 
of time required until a condition upon which the 
conditional flow instruction is based has been 
resolved. 

15 

The data processor (10) of claim 1 wherein the 
stored control value further comprises a multi-bit 
value which is additionally used by the data proces- 
sor (10) to control additional instruction execution 
functions, the additional instruction execution func- 20 
tions comprising controlling prefetching of further 
instructions following the conditional flow instruc- 
tion based upon a direction of flow indicated by the 
conditional flow instruction. 

25 

The data processor (1 0) of claim 1 wherein the con- 
ditional flow instruction is one of a trap or jump 
instruction. 

The data processor (1 0) of claim 1 wherein the con- 30 
trol unit (18) further comprises: 

an encoded value for the stored control value in 
which the instruction prefetch unit (26) will con- 
ditionally execute additional instructions in 35 
sequential order from the conditional flow 
instruction in response to the conditional flow 
instruction indicating a first direction of instruc- 
tion flow, and the instruction prefetch unit (26) 
will conditionally execute additional instructions 40 
by jumping to a predicted destination instruc- 
tion in response to the conditional branch 
instruction indicating a second direction of 
instruction flow. 

45 

A method of implementing an instruction change of 
flow in a data processor (10), comprising the steps 
of: 

sequentially fetching with an instruction so 
prefetch unit (26) selected ones of a plurality of 
instructions: 

selectivety decoding the selected ones of the 
plurality of instructions which are fetched; 
selectively executing the selected ones of the 55 
plurality of instructions which are decoded: and 
using a control value which directly controls the 
instruction prefetch unit (26) by selectively dis- 



abling for a predetermined amount of time the 
instruction prefetch unit (26) from fetching any 
further instructions in direct response to a con- 
ditional flow instruction being detected, the dis- 
abling reducing overhead of the data processor 
(10) by completely avoiding a fetch operation 
until the predetermined amount of time has 
elapsed, at which time prefetching by the 
instruction prefetch unit (26) is automatically 
resumed- 

9. The method of claim 8 further comprising using a 
multi-bit value as the control value to control addi- 
tional instruction execution functions, the additional 
instruction execution functions comprising control- 
ling prefetching of further instructions following the 
conditional flow instruction based upon a direction 
of flow indicated by the conditional flow instruction. 

10. A method of implementing conditional branch exe- 
cution in a data processor (10). comprising the 
steps of: 

fetching a plurality of instructions to be exe- 
cuted with an instruction fetch unit (26); 
decoding the instructions for execution by an 
execution unit (40); and 
controlling operation of the data processor ( 1 0) 
with a control circuit (18) which provides a con- 
trol signal to the instruction fetch unit (26) in 
response to detecting a conditional branch 
instruction, the control signal respectively con- 
trolling, based on a determination of whether a 
direction of change instruction flow required by 
the conditional branch instruction is forward or 
backward, whether to make the instruction 
fetch unit fetch and conditionally execute addi- 
tional instructions in a sequential manner or to 
fetch and conditionally execute additional 
instructions by jumping to a predicted destina- 
tion instruction. 
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